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A DYNAMIC PROGRAMMING APPROACH TO THE PARISI FUNCTIONAL 


AUKOSH JAGANNATH AND IAN TOBASCO 


Abstract. G. Parisi predicted an important variational formula for the thermodynamic limit of the 
intensive free energy for a class of mean field spin glasses. In this paper, we present an elementary 
approach to the study of the Parisi functional using stochastic dynamic programing and semi-linear 
PDE. We give a derivation of important properties of the Parisi PDE avoiding the use of Ruellc 
Probability Cascades and Cole-Hopf transformations. As an application, we give a simple proof of 
the strict convexity of the Parisi functional, which was recently proved by Aufiinger and Chen in 

m- 


1. Introduction 


Consider the mixed p-spin glass model on the hypercube Ejv = {—1,1}, which is given by the 
Hamiltonian 

H N (a) = H' N (a ) + h X a t 

i 

where H' N is the centered gaussian process on E^r with covariance 

E H^H^a 2 ) = m((a\a 2 )/N). 


The parameter £ satisfies £(t) = ^ p>1 Ppt p where we assume there is a positive e such that £(l+e) < 
oo, and h is a non-negative real number. It was predicted by Parisi m, and later proved rigorously 
by Talagrand [19] , and Panchenko m, that the thermodynamic limit of the intensive free energy 
is given by 


lim 

N— too N 


SF lo « E 


0 H N (a) 


ctGSjv 


inf V(u;£,h) a.s. 
M ePr[0,l] 


Here Pr([0,1]) is the space of probability measures on [0,1], and the Parisi functional, V, is given 
by 

l f 1 

'P{n\^h) = « M (0,/i) - - J €"(t)fj,[0,t\tdt, 


where u^ solves the Parisi PDE: 


dtu^t, x ) + ( d xx u^(t , x) + n [0, t] (d x Un(t, x)) 2 j = 0 (t, x) € (0,1) x M 

Ufj,(l,x) = log cosh (x). 


In the case that ^ has finitely many atoms, the existence of a solution of the Parisi PDE and its 
regularity properties are commonly proved using the Cole-Hopf transformation and Ruelle Prob¬ 
ability Cascades. A continuity argument is then used to extend the definition of u^ to general n 
and to prove corresponding regularity properties. Such approaches do not address the question of 
uniqueness of solutions. See [2U m QJ 12 for a summary of these results. 


2010 Mathematics Subject Classification. Primary: 60K35, 82B44, 82D30, 49N90; Secondary: 35Q82, 35K58, 
49S05. 

Key words and phrases. Parisi formula; Sherrington-Kirkpatrick model; Dynamic Programming. 

1 




In this note, we present a different approach. In Section [2l we prove the existence, uniquness, 
and regularity of the Parisi PDE using standard arguments from semi-linear parabolic PDEs. 

Theorem 1. The Parisi PDE admits a unique weak solution which is continuous, differentiable in 
time at continuity points of p, and smooth in space. 

See Section [2] for the precise statement of this result, and in particular for the definition of weak 
solution. Due to the non-linearity of the Parisi PDE, low regularity of the coefficients, loss of 
uniform ellipticity at t = 0, and unboundedness of the initial data, the proof of Theorem |T] requires 
the careful application of many different (though relatively standard) arguments in tandem. 

The presentation of a PDE driven approach to the study of this functional is not only of interest 
to experts in the field of spin glasses, but may also be of interest to practitioners of the Calculus of 
Variations, PDEs, and Stochastic Optimal Control. There are many important, purely analytical 
questions surrounding this functional that must be addressed before further progress on questions 
in spin glasses can be made. See mmm for a discussion. Some of these questions are thought 
to be intractable to the methods currently used in the spin glass literature but appear to be well- 
suited to the techniques of the aforementioned fields; as such it is important to present the study 
of this functional in a language that is both basic and palatable to their practitioners. 

Besides its intrinsic interest, the preceding theorem has useful applications to the study of the 
Parisi functional. After proving the existence of a sufficiently regular solution to the above PDE, 
we can use elementary arguments from stochastic analysis to prove many important and basic 
properties of this functional, such as fine estimates on the solution of the Parisi PDE and the strict 
convexity of the Parisi functional itself. 

As a first application of this type, we further develop the well-posedness theory of the Parisi 
PDE by quantitatively proving the continuity of the solution in the measure p. We also prove 
sharp bounds on some of the derivatives of the solution. Such bounds are important to the proofs 
of many important results regarding the Parisi functional, see for example Talagrand’s proof of the 
Parisi formula in m and also mm- They were previously proved using manipulations of the 
Cole-Hopf transformation and Ruelle Probability Cascades m- This is presented in Section 12.41 

As a further demonstration how Theorem (T] can be combined with methods from stochastic 
optimal control, we present a simple proof of the strict convexity of the Parisi functional. As 
background, recall the prediction by Parisi m that the minimizer of the Parisi functional should 
be unique and should serve the role of the order parameter in these systems. The question of the 
strict convexity of V was first posed by Panchenko in p3j as a way to prove this uniqueness. It was 
studied by Panchenko m, Talagrand nans], Bovier and Klimovsky [3J, and Chen [5], and finally 
resolved by Auffinger and Chen in their fundamental work [2]. The work of Auffinger and Chen 
rested on a variational representation of the log-moment generating functional of Brownian motion 
M, which they combine with approximation arguments to give a variational representation for 
the solution of the Parisi PDE. We note here that an early version of this variational representation 
appeared in [3], where it is shown, using the theory of viscosity solutions, to hold when the coefficient 
p[0, t] is piecewise continuous with finitely many jumps. 

Since the Parisi PDE is a Hamilton-Jacobi-Bellman equation, it is natural to obtain the desired 
variational representation for its solution as an application of the dynamic programming principle 
from stochastic optimal control theory. The required arguments are elementary, and are commonly 
used in studying nonlinear parabolic PDEs of the type seen above. We prove the variational 
representation in Section [3l and then deduce from it the strict convexity of the Parisi functional in 
Section QJ 

Theorem 2. The functional V(p;^, h) is strictly convex for all choices of £ and h. 

The variational representation which was discussed above is given in Lemma HBJ From this it 
follows immediately that one has the following representation for the Parisi Formula. 
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Proposition 3. The Parisi Formula has the representation 


lim — log 

N—too N 


£■ 




inf sup E 

MGPr([0,l]) aeAo 


log cosh Of £"(s)//[0, s]a s ds + J \/£"{s)dW s + h 


~\j Q £"( S MM (a 2 s + s) ds 

where Ao consists of all bounded processes on [0,1] that are progressively measurable with respect 
to the filtration of Brownian motion. 
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2. Well-posedness of the Parisi PDE 

Let u : [0,1] x R —» R be a continuous function with essentially bounded weak derivative d x u. 
We call u a weak solution of the Parisi PDE if it satisfies 


0 = f f —udt4> + ^ ^ (ud xx (j) + n [0, t] ( d x u ) 2 (p\ dxdt + f r/> (1, x) log cosh x dx 

Jo Jr 2 V 'Jr 

for every cj) € C£° ((0, 1] xK). We now state the precise version of Theorem [T] from the introduction. 

Theorem 4. There exists a unique weak solution u to the Parisi PDE. The solution u has higher 
regularity: 

• diu € Cb ([0,1] x M) for j > 1 

• dtdiu € L°° ([0, 1] x R) for j > 0. 

For all j > 1, the derivative dfu is a weak solution to 

f d t d J x u + (d xx diu + fi [0, t] di (d x uf^j = 0 (t, x ) € (0,1) x R 

(l,x) = logcoshx x€R 

Remark 5. The solution described in [Tj can be shown to be a weak solution of the Parisi PDE, 
using the approximation methods developed there. It was also shown in [1] that this solution has 
the higher regularity described above. 


Remark 6. The reader may notice that the essential boundedness of d x u is not strictly necessary 
to make sense of the definition of weak solutions. It is used in the proof of uniqueness in an essential 
way, however we do not claim that this proof is optimal by any means. 


Continous dependence is proved in Section 12.41 

We begin the proof of Theorem [4j After performing the time change t —>• s (t) = ^ (£' (1) — f (t)) 
and extending the time-changed CDF p [0, s _1 (t)] by zero, we are led to consider the semi-linear 
parabolic PDE 


( 1 ) 


dt'U — A u = m ( t ) (t, x) € M+ x R 

u (0, x) = g (x) x € R 
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where g (x) = log cosh x and m{t) = g [0, s _1 ( [t )] lt<(£'(i)-£'(o))/ 2 - We carry over the definition of 
weak solution from before: a continuous function u : [0, oo) x R — )• R with essentially bounded weak 
derivative d x u is a weak solution to m if it satisfies 

r oo r r 

0 = / / udt4> + ud xx (f> + m{t) ( d x u ) 2 (j) dxdt + 4> (0, x) g{x) dx 

Jo Jr Jr 

for every cj) € C%° ([0, oo) x R) . Evidently, the existence, uniqueness, and regularity theory of weak 
solutions to the Parisi PDE is captured by that of (HD- 

Our proof of the well-posedness of (P) boils down to the study of a certain fixed point equation, 
which we introduce now. Let e tA be the heat semigroup on R, i.e. 

(e tA h) (x) = -^= f e _Ji 4 r~h(y) dy. 
y/kirt J r 

Then, u weakly solves <tu> if and only if u satisfies 

(2) u ( t ) = e tA g + f e^ t ~ s " >A m. ( s ) u x ( s ) ds. 

Jo 

This is an application of Duhamel’s principle (see e.g. [6, Ch. 2]). For completeness, we present 
this in Proposition 1241 

In Sections I2.1H2.3I below, we prove the existence, uniqueness, and regularity of fixed points of 
j2| on a certain complete metric space. The properties of g and m we will be using are that 

• g' € L°° and £jg € L 2 n L°° for j > 2 

• m is a monotonic function of time alone and HmHoo < 1. 

These properties will inform our choice of space on which to study ([2]). The exact bound on m 
does not matter, but we include it for convenience. 

Once Theorem[4]is established, one can give a quick proof of the final component of wellposedness, 
namely the continuity of the map from g to the corresponding solution of the Parisi PDE, using 
standard SDE techniques. This is in Section [2~4l 

The notation < c denotes an inequality that is true up to a universal constant that depends only 
on c. Throughout the proofs below, we will use two elementary estimates for the heat kernel which 
we record here: 

(3) \\e tA \\LP^Lp < 1 and \\d x e tA \\Lp^Lp 

2.1. Existence of a fixed point. We prove existence of a fixed point to ([2]). First we show there 
exists a solution for short-times t < T*, then by using an a priori estimate we prove a solution 
exists for all time. 

Short-time existence comes via a contraction mapping argument. Define the Banach space 
x = {'i/j e L°° (M)} n {ip x € L°° (K)} n {ip xx e L 2 (R)} 

with the norm 

U\\x = Halloo V Halloo V 11 Ipxx 11 2 j 
and for each T > 0 define the complete metric space 

X? = {e tA h + <f> : <f> € L°° ([0, T] ; A')} n { ||</>a;||L°°([ 0 ,T]xR) < ll^lloo, | |0n| |l oo ([ 0 ,T];L 2 (R)) ^ ll^lb} 
with the distance 

( w ’ u) = \\u — vW^gg^X)- 

The symbol h in the definition of the space refers to the initial data, which is assumed to satisfy 
h! € L°° and h" € L 2 . 
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Given it E XIf define the map 

(4) A[u] = e tA h+ f e ( ' t ~ s ' >A m (s) u 2 x (s) ds. 

Jo 

Lemma 7. (short-time existence) Let 

(5) T* (h) = min jl, [C • (||h'||oo + ll^'lk)] -2 } 

where C E M+ is a universal constant. Then for all T E (0, T*), 

• (self-map) A : X!f Xtf 

• (strict contraction) There exists a < 1 such that 

d X h (A [it], A [u]) < a ■ d X h ( u , v) , u, v E x!f. 

Therefore for every T < T* (h) there exists u E Xlf satisfying u = A [it]. 

Proof. First we prove A is a self-map. Let it E Xff and call 

= A [it] — e tA h = f e (*- s ) A m ( s ) ij 2 ( s ) ds. 

Jo 

Note that 

if x = f d x e ( ' t ~ s ' >A mu x (s) ds 

Jo 

'f’xx = / d x eJ t ~ s ^ A 2mu x u xx {s) ds. 

Jo 

The estimates in ([3]) and the definition of Xtf imply the bounds 

IMIl°°([o,t]xR) < T\\h'\\lo 
IIV , i||l oo ([o,t]xR) < T 1 / 2 ||/i , ||^ 0 
I IV’xx] Il°°([0,T];L 2 (R)) ^ T^J 2 ||h/||oo|| h"\ I2 . 

Therefore there is a universal constant C E M+ such that A : Xtf —>• Xff whenever 

T<T 0 (h ) = (CHh'lloo)" 2 . 

Now we prove A is a strict contraction. Let u, v E Xtf and call 

D = A [it] — A [u] = f e (t- s ) A m (it^ (,s) — ^ (s)) ds. 

Jo 

The estimates in ([3]) and the definition of Xif give 

d x n(A [«],A[t;]) <C'-max{T||h'|| 00 ,T 1 / 2 ||/i , || 00 ,T 1 / 2 (||/t"|| 2 + Wh']^)} d x n (u,v) 
where C E M + is a universal constant. Therefore, if 

Ti {h) = minjl, [C • (||/i'||oo + ||h"|| 2 )] _2 } 

then A is a strict contraction on Xlf for all T < Tq A T\. Since T\ < To we may take T* = T\. □ 
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To prove the existence of a global-in-time solution to ([2]) we will work in the space 

X T = {e tA g + cf : cf E L°° ([0, T] ; X)} 

defined for each T E R+. Note C Xt so that by Lemma 0 if we take T < Tfig) then there 
exists u € Xt satisfying the fixed point equation (0). To extend u to all of time we require the 
following a priori estimates. 


Lemma 8. (a priori estimates) Let T E and assume u E Xt satisfies ([2]). Then 

I l^krl Il oo ([0,T]xR) < llfflloo 
11 U xx | |l°°([0,T];L 2 (R)) < exp (llg'H^T) . 

Proof. The estimate on u x is derived by the maximum principle. By Corollary [TT] (see below) we 
have 

dfu x (t, x) — A u x ( t, x) = 2m (t±) u x d x u x (t, x) , V ( t , x) E (0, T) x M 
and by assumption u x is bounded. Now the usual proof of the maximum principle for linear 
parabolic PDE in unbounded domains goes through m- 
For the estimate on u xx observe that 

u x = e tA g' + f e P- s ) A 2 mu x u xx (s) ds, 

Jo 

so by a standard energy estimate (see Lemma mi below) we have for almost every t <T 

2 

2 - 

The desired result follows from Gronwall’s inequality [6] and the a priori bound on u x . □ 

Corollary 9. (global existence) For each T E M+, there exists ut € Xt satisfying (f2j). The 
solutions {ut}t€K+ so produced agree on their common domains. 


< 2||ti x || io0 ([o,T]xR) / I| (s)ds T ||p 

J 0 


Proof. Define the maximal time of existence Tm to be the supremum over T E M+ such that there 
exists ut € Xt satisfying © . If Tm < oo then by Lemma [7] we must have 

limsup ||(ut)x||l°°([o,t]xR) + I \(ut)xx\ Il°°([o,t] ; l 2 (r)) = °°> 

txt m 

otherwise we could construct a solution extending for times beyond Tm ■ Therefore by Lemma [8] 
we must have Tm = oo. 

A quick application of Lemma fT3l shows that ut = ut> for t < T A T'. 

□ 


2.2. Regularity of fixed points. One proves the higher regularity of the fixed point u by a 
parabolic bootstrapping procedure. 

Lemma 10. (higher regularity) Assume u E Xt satisfies (|2j) . Then u satisfies 

• dfu € L°° ([0, T] ; L 2 (R) 0 L°° (R)) for j> 2 

• dtu E L°° ([0, T] x R) and d t diu E L°° ([0,T] ; L 2 (R) 0 L°° (R)) for j > 1. 

Proof. Let us describe the first step of the argument. Since u E Xt we have u x E Lffi and 
Uxx € Lf°L 2 . Our goal will be to deduce u xx E Lffi and u xxx € Lf^L 2 . It will be important to note 
we are working on the finite-time domain [0,T] x R, so that in particular L'jfiL 2 C L 2 X . 

Start by writing 


then by Lemma [T2l we get u xxx E L 2 X . Since mu x u xx E Lf°L 2 , g" E L°° and 

Uax = e tA g" + [ d x e^~ s ^ A 2mu x u xx (s) ds, 

Jo 

we conclude that u xx E Lff. Here we have used that / 0 * d x e^~ s ^ A ds : Lf°L 2 — > L which follows 
from ©. 

Now 


dx ( niiij- '(I ,-,-) — hi {u xx + u x u xxx J) E so that — eg-e^ ^ 2??t. {u xx T u x u xx fij ds 

Jo 


and hnally we conclude u xxx E Lf°L 2 using Lemma fl2l again. 

The rest of the estimates on dfu are proved in the same way; the dt&fu estimates follow easily. □ 


There is a sense in which the weak solution u is a classical solution. 


Corollary 11. Let u E Xt satisfy ([2]) . Then for all j > 0 we have 

• diu exists pointwise and is continuous 

• the left/right derivatives dfdfu exist pointwise, and dtdfu exists at continuity points of m 
Moreover, we have that 

dfd J x u ( t, x) — A d J x u (t, x) = m (f±) d J x [u 2 ] (t, x), V (t, x) E (0, T) x R. 

For completeness, we record the energy estimate which was used above. The proof is standard 
(see 0 ) and is omitted. 

Lemma 12. Let h be weakly differentiable with hf E L 2 and let f E L 2 ([0, T] x R). Then 

if(t) =e tA h+ fe^mds 

Jo 

satisfies 

IIV’x|Il°°([ 0,T];L 2 (R)) + IIV’xa;|lL 2 ([ 0 ,T]x]R) — 11 f\ ll 2 ([0,T] xR) + H^ 1 Hl 2 (R)' 

2.3. Uniqueness of fixed points. Since we used a contraction mapping argument to construct 
fixed points for (|4]) in the spaces Xtf, we have implicitly demonstrated a uniqueness theorem there. 
The following result achieves uniqueness without mention of the second derivative u xx . 


Lemma 13. Assume u,v : [0, T] xK->R are weakly differentiable and that u x , v x are essentially 
bounded. Then if u,v satisfy the fixed point equation (f2|) . it follows u = v. 


Proof. In the following, C denotes a universal constant which may change from line to line. Let 
d = u — v, then by assumption we have 

rt 


d(t) = f e*J s ^ A m (s) ( u x + v x ) d x (s) ds, t < T. 

Jo 


Therefore 


d x (t) = [ d x e (t s ' >A m(s)(u x + v x )d x (s)ds, t<T. 

Jo 

Using the second heat kernel estimate in ([2]), we conclude the contractive estimate 

[* 1 

IMzl |L°°([0,t]xR) — C\\u x + Ux||l°°([ 0 ,T]xR) / ,, \\d x (g)||L°°(dx) ds 

Jo V t — s 

for all t < T. It now follows from an iterative argument that d x = 0, and hence that d = 0. To see 
this note that if d x = 0 on [0, t\] x R, then by the contractive estimate above, 

H c 4||L 00 ([t 1 ,t]xR) < C\\u x + 'Lr||l,° o ([0,T]xR) y/t ~ U| \d x \ |l,°°([t 1 ,t]xR) 





for all t € [ti, T]. Therefore d x = 0 on [0, t\ + e] where e depends only on the L°° bounds on u x ,v x . 
This completes the proof. □ 


2.4. Continuous dependence of solutions. For convenience we metrize the weak topology on 
the space of probability measures on the interval Pr [0,1] with the metric 

d (p, v) = / [0, 5 ] — v [0, 5 ] | ds. 

Jo 

Lemma 14. Let p,n £ Pr[0, 1] and u,v be the corresponding solutions to the Parisi PDE. Then 

Ik-HU < £"(1 )d(n,v) 

II u x - fxlloo < exp (£' (1) - £' (0)) £" (1 )d(p,u). 

Remark 15. The hrst inequality is originally due to Guerra HU. 


Proof. Let u, v solve the Parisi PDE weakly, then w = u — v solves 

f w t + (w xx + p[ 0, t] (u x + v x ) w x + (/r[0, t\ - u[0, t]) v x ) = 0 (t, x) € (0,1) x R 

1 w (l,x) = 0 iGl 


weakly. Since u x ,v x are Lipschitz in space uniformly in time and bounded in time, we can solve 
the SDE 

dX t = f" (t) p [0, t] (t, Xt) dt + 

Furthermore, as w weakly solves the above PDE and has the same regularity as u and v, we can 
write 

w (t, x) = E Xt=x (J^ (s) (p [0, s\-v [0, s]) v 2 x (s, X s ) ds^j 
by Proposition [22j Therefore 

Halloo < £" (1) d (p, v) 

since f" is non-decreasing and ||'y a; ||^ 0 < 1 by Lemma [TUI 

Differentiating the PDE for w in x, one finds by similar arguments to Proposition that w x 
has the representation 

w x (t, x) = E Xt = x ^ E ( t , s) f" (s) (p [0, s]-u [0, s}) v x v xx (, s , X s ) ds'] 

where 

E (t, s ) = exp f" (r) p [0, r] Vxx + Uxx (r, X T ) dr^j . 

Using that Halloo < 1 and ||u xx ||oo V llu^Hoo < 1 from Lemma ITU1 and since f" is non-decreasing, 


w x 


00 — 




□ 


Lemma 16. The solution u to the Parisi PDE satisfies \u x \ < 1 and 0 < u xx < 1. 

Remark 17. The Aufffnger-Chen SDE and the corresponding Ito’s formula’s for u x and u xx used 
in the proof below were first proved in [2j using approximation arguments. 





Proof. Using the PDEs for u x , u xx given in Theorem [U along with Proposition 1221 we can write 


u x (t, x ) = E Xt =x (tanhXi) 

u xx (t, x ) = E Xt =x ^sech 2 Xi + £" ( s ) /i [0, s] u 2 xx (s, X s ) ds 

where Xf solves the Auffinger-Chen SDE 

dX t = £" ( t ) /i [0, t] u x (t, X t ) dt + y/£" ( t)dW t ■ 

The first equality immediately implies the bound on u x , and the second equality implies u xx > 0. 
Then by a rearrangement one finds 


U X x ifi %) — 1 


lA. °> (*> x ) - E Xt=x (J u 2 x (s, X s ) d/i (s) 


and u rr < 1 follows. 


□ 


3. A VARIATIONAL FORMULATION FOR THE PARISI PDE 

In this section we use the methods of dynamic programming (see e.g. [8]) to give a new proof of 
the variational formula for the solution of the Parisi PDE. 

Lemma 18. Let u M solve the Parisi PDE as above and define the class At of processes a s on [t, 1] 
that are bounded and progressively measurable with respect to Brownian motion. Then 

i r 1 

(6) u,j(t,x)= sup Ex“ =; r / £"(sM0, s]a 2 ds + logcosh(Xf) 

a&At L ^ Jt 

where Xf solves the SDE 

(7) dXf = t"( 8 )n[0, s]a s ds + y/f”{s)dW s 
with initial data Xf = x. Furthermore, the optimal control satisfies 

At[0, s]a* = n[ 0, s]u x (s, X s ) a.s. 

where X s solves the Auffinger-Chen SDE with the same initial data: 

dX s = £”(s)p,[0,s]d x u(s,X s )ds + y/£"(s)dW s . 

Remark 19. This formula was first proved by Auffinger and Chen in [2]. Taking advantage of the 
Cole-Hopf representation in the case of atomic //. they prove the lower bound for every a using 
Girsanov’s lemma and Jensen’s inequality. They then verify that their optimal control achieves the 
supremum, by an application of Ito’s lemma. The uniqueness follows from a convexity argument. 
In contrast, we recognize the Parisi PDE as a specific Hamilton-Jacobi-Bellman equation. It is 
well-known that the solution of such an equation can be seen as the value function of a stochastic 
optimal control problem. As such, this representation can be obtained by a textbook application 
of “the verification argument”. This argument simultaneously gives the variational representation 
and a characterization of the optimizer. We also note that the argument presented here is more 
flexible, as is evidenced by replacing the nonlinearity u x with F(u x ) in the Parisi PDE, where F 
is smooth, strictly convex, and has super linear growth. In particular, observe that one cannot 
use the Cole-Hopf transformation on the resulting PDE, but the arguments of this paper follow 
through mutatis mutandis. 
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Proof. Let u solve the Parisi PDE. Notice that the nonlinearity is convex, so if we let 

L(t,X) = -£"(t)/r[M 
f(t, A) = £" (*) n [0, t) A, 
then by the Legendre transform we have 

£" (*) M [0, i] = £"(f)//[0, f] sup {—A 2 /2 + A3 x u} = sup {L (f, A) + / (t, A) d x u) . 

^ AeR AeR 

Therefore, we can write the Parisi PDE as a Hamilton-Jacobi-Bellman equation: 

£» (t) 

0 = d t u+ 

dxx^ + sup {L (t, A) + / (t, A) d x u} . 

4 AeR 

Since a s in At is bounded and progressively measurable, we can consider the process, X a , which 
solves the SDE 

dX a = f(s, a s )ds + y/£"(t)dW 

with initial data X° = x. This process has corresponding infinitesimal generator 

£(*, a) = ^f"(t)d xx + f(t , a)d x . 

Notice that u is a (weak) sub-solution to 

dt.u + C(t, a)u + L(t , a) < 0 

with the regularity obtained in Theorem |4l It follows from Ito’s lemma (Proposition 1221) that 

u(t, x) 

The result now follows upon observing that the control u x (s,X s ) achieves equality in the above 
since it achieves equality in the Legendre transform. That this control is in the class At can be 
seen by an application of the parabolic maximum principle (Lemma 1161 . Uniqueness follows from 
the fact that A achieves equality in the Legendre transform if and only if 

£"(f)//[0,f]A = €"(t)n[0,t\u x - 

□ 


> sup E a 
aS At 


T 


L ( s , a s ) ds + log cosh (X °) 


Applying this representation to the Parisi formula gives Proposition 3. 


4. Strict convexity 

As an application of the above ideas, we give a simple proof of strict convexity of V. 
Theorem 20. The Parisi Functional is strictly convex. 

Proof. We will prove /x —>• u^ (0, h ) is strictly convex. Then 

1 h 1 

V(n) = u^{0,h) - 2 y o ^"(t)n[0,t}sds 

will be the sum of a strictly convex and a linear functional, so "P will be strictly convex. 
Recall 

-1 „,2 


Ufj(0,h) = sup E h 
aGAo 


, a 


-£"(s)/x[0, s] ds + log cosh (Xf) 


'o 
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Fix distinct n, v € Pr [0,1] and let fig = + (1 — 6) is, 9 € (0,1). Let a 9 be the optimal control 

for the Parisi PDE associated to /jlq, so that 

„e\ 2 


Ua e (0, h) = E h 


f 1 (a 9 ) / e\ 

J -£"(s)no[0, s]-^y- ds + log cosh (xf J 


Consider the auxiliary processes Y t a and Zf given by solving 

dY t = 0, t\a 9 dt + \J £"( [t)dWt and dZ t = 0, t\a e t dt + f f"(t)dWt 

with initial data Yq = Zq = h, and note that 

Xf = BY? + (1 - 6)zf. 

By the lemma below, P{Y\ ^ Z \) > 0. Therefore by the strict convexity of log cosh and the 
variational representation (0, 

(°> h ) = E h 


<eU h 


r 1 (a 9 ) / eN 

J -f" («) Te [0, s] K 2 ds + log cosh (Af j 

r\ (ft 9 f / 

J (s) M [o, s] - Y ds + log cosh (Yf* 

r 1 (a 9 f / e \ 

J —(s) V [0, s] —^— ds + log cosh (zf J 


+ (1 - 0) \ E h 
< Ou^O, h) + (1 — 9)u u (0 , h ) 

as desired. 

Lemma 21. Let Yt and Zt be as above. Then P{Y\ 7 ^ Zi) > 0. 
Proof. It suffices to show that 


□ 


By definition we have 


Y\ - Z\ = 


Var(Y 1 - Zi) > 0. 


[ C"(«)(m[0,s] - v[0,s])a 6 s ds. 
Jo 


Observe that by the PDE for u x in Theorem [4] and Ito’s lemma (see Proposition 1221) . the optimal 
control a 9 = (u M ) x is a martingale, 

rt 


<4 -4 = [ fffs)u xx (s, X s )dW s 
Jo 


Therefore if we call A s = £"(s)(/i[0, s] — u\ 0, s]), 

Var(Y\ — Z\) = ( f A s (a 9 — a^ds^) = f A s A t K(s,t) dsdt 

\J o / J [o.il 2 


where 


K(s,t) = E h (a 9 - a 9 ) ■ (a 9 - a 9 0 


Now since A s G L2[0,1], it suffices to show that K(s,t) is positive definite. We have 


K(s,t) = E h 


V^4)u xx (s, xf') dW s • J*-ffft)u xx (t, xf ) dWt 


L0 

rt/\s 


rt/\s 

/ i"{t')E h u 2 xx {t', Xp )dt' = p (t A s) = p{t) A p(s) 
Jo 


li 























where 


p(s)= ( s eMAt',xf)dt'. 

Jo 

By the maximum principle (Lemma fT6l) . u xx > 0, so that p(t) is strictly increasing. Since this 
kernel corresponds to a monotonic time change of a Brownian motion, it is positive definite. □ 


5. Appendix 

We will say that a function / : [0, oo) xl -> I with at most linear growth if it satisfies an 
inequality of the form 


|/(*,z)| <T 1 + M VT G R+, (t,x) G [0, T] x R. 

We will say the same in the case that / : R —x R with the obvious modifications. In the following 
we fix a probability space (fl, F, P) and let Wt be a standard brownian motion with respect to P. 
Let Ft be the filtration corresponding to Wt■ 

To make this paper self-contained, we present a version of Ito’s lemma in a lower regularity 
setting. The argument is a modification of [171 , Corr. 4.2.2], 

Proposition 22. Let a,b : [0, T] x (Q,F,P) —X R be be bounded and progressively measurable with 
respect to Ft and let a > 0. Let X t solve 

dX t = \J a(t)dWt + b(t)dt 

with initial data Xo = x. Let L = \a(t, ui)A + b(t,u)d x . Finally assume that we have u satisfying: 

(1) u € C([0,T] x R) with at most linear growth. 

(2) u x , u xx G Cb([0,T] x R) 

(3) u is weakly differentiable in t with essentially bounded weak derivative ut, and which has a 
representative that is Lipschitz in x uniformly in t. 

Then u satisfies Ito’s lemma: 

u(t, X t ) — u(s, X s ) = f (d t + L)u(s',X s ')ds' + f u x (s', X s ,) y 7 a(s')dW s i 

J S J S 

Remark 23. This result is applied throughout the paper to the solution u from Theorem Q] and 
its spatial derivatives. We note here that, given the regularity in Theorem 21 the weak derivatives 
dtdiu, j > 0, have representatives satisfying the above Lipschitz property. 


Proof. To prove this, we will smooth u by a standard mollification-in-time procedure and apply 
Ito’s lemma. Without loss of generality, assume T = 1 and s = 0. Extend u to all of space-time by 


u(t, x) 


w(0, x) t < 0 
u{ 1, x) t > 1 


Abusing notation, we call the extension u and note that it satisfies each of the assumptions above. 
Let 4>{y) G CfP(— 1,1) with 0 < (f> < 1 and f (f> = 1, and define 4> e (s) = <f>(s/e)/e. Define the 
time-mollified version of u as 




Since u e E C 1 ' 1 has bounded derivatives, and grows at most linearly, Ito’s lemma implies that 

u e (t,X t ) - u e (0, x) = [ (d t + L)u e (s,X s )ds + f u e x (s, X s )y/adW s 
Jo Jo 

= / ul(s,X s )ds + / Lu e (s, X s )ds / u x (s, X s )yfadW s 
Jo Jo Jo 

= A e + B e + C e 


for all e > 0. Since these quantities are well-defined at e = 0, it suffices to show their convergence. 
First we show the left-hand side converges. Note u is Lipschitz with constant ||Vu||oo- Therefore, 


supsup|u e (t, x) — u(t,x) | 
ccEM t 


sup sup | 
x€M t o 


0 (y) (u(t-ey,x) 


u(t,x )) dy | < HVullooC. 


Thus u e (t,X t ) —>• u(t,Xt ) uniformly P- a.s. 

Now we consider the right-hand side. For A e , note that since ut is Lipschitz in x uniformly in t, by 
an application of Lebesgue’s differentiation theorem, we have that u\ —>• ut for all x, Lebesgue-a.s. 
in t. Thus by the bounded convergence theorem, we have that 


sup 

t€[0,l] 




Ut (s, X s 



u e t (s,X s ) - u t (s,X s )\ds ->• 0. 


Thus, A e —> A uniformly P- a.s. 

The convergence for B e follows from a similar argument. Since u x , u xx € Cb, commuting deriva¬ 
tives with mollification shows that u% and v/ xx converge to u x and u xx pointwise. Then, the bounded 
convergence theorem implies that B e —>• B uniformly P- a.s. just as before. 

Now we prove uniform a.s. convergence of C e to C. Combining the above arguments proves 
that C e is uniformly a.s. convergent, so it suffices to check its convergence to C in probability. By 
Doob’s inequality and Ito’s isometry, 

P [ sup | f u e x ^/adW s - f u x y/adW s \ > r? ) < a \ [ E| u% - u x \ 2 ->■ 0 

\te[o,i] Jo Jo J V Jo 

where the last convergence is again by the bounded convergence theorem. □ 


We finish with a discussion of Duhamel’s principle, which justifies the introduction of the fixed 
point equation Q in the proof of Theorem [JJ Note that since our weak solutions satisfy d x u E L°° 
by definition, they have at most linear growth. 


Proposition 24. Suppose that u, f : [0, oo) xIe I, g:M—>-M have at most linear growth. 
Assume that f is Borel measurable, and that u and g are continuous. Then 


(9) 


0 = 



udt4> + ud xx (j) + f(p dxdt + 


if and only if 


cf) (0, x) g (x) dx V 4> E C^° ([0, oo) x R) 


( 10 ) 


u(t) = e tA g+ f s ^ A f(s)ds 

Jo 


Vf E [0,oo). 


Remark 25. Although the assumption of linear growth is not optimal, it will be sufficient for our 
application. Implicit here is a uniqueness theorem for weak solutions of the heat equation with at 
most linear growth. Recall that even classical solutions fail to be unique without certain growth 
conditions at \x\ = oo (see e.g. m ch. 7]). 
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Proof. That u satisfies (J9|) if it satisfies (|10D is clear in the case that /, g are smooth and compactly 
supported. Then, a cutoff and mollification argument upgrades the result to the given class. 

In the other direction, suppose that u satisfies ([9]). Define the function 


0 (i, x) = u (t, x ) - [e tA g (•)] (x) 


I' [e ( ‘- s)A /(v 

Jo L 


(®) 


ds, 


which is continuous and satisfies 0 (0, •) = 0. By a similar argument as above, 0 satisfies the heat 
equation in the sense of distributions on M + x R. Since the heat operator is hypoelliptic, it follows 
that 0 is a classical solution [S|. By its definition, 0 grows at most linearly since the same is true 
for u, /, and g. By the maximum principle for the heat equation in unbounded domains [12], we 
conclude that 0 = 0. □ 
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